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Abstract 

In this paper we consider strong Nash equilibria, in mixed strategies, for finite games. 
Any strong Nash equilibrium outcome is Pareto efficient for each coalition. First, we 
analyze the two-player setting. Our main result, in its simplest form, states that if a 
game has a strong Nash equilibrium with full support (that is, both players randomize 
among all pure strategies), then the game is strictly competitive. This means that all 
the outcomes of the game are Pareto efficient and lie on a straight line with negative 
slope. In order to get our result we use the indifference principle fulfilled by any Nash 
equilibrium, and the classical KKT conditions (in the vector setting), that are necessary 
conditions for Pareto efficiency. Our characterization enables us to design a strong-Nash- 
equilibrium-ffiiding algorithm with complexity in Smoothed-T’. So, this problem—that 
Conitzer and Sandholm [Conitzer, V., Sandholm, T., 2008. New complexity results about 
Nash equilibria. Games Econ. Behav. 63, 621-641] proved to be computationally hard in 
the worst case—is generically easy. Hence, although the worst case complexity of finding 
a strong Nash equilibrium is harder than that of finding a Nash equilibrium, once small 
perturbations are applied, finding a strong Nash is easier than finding a Nash equilibrium. 
Next we switch to the setting with more than two players. We demonstrate that a strong 
Nash equilibrium can exist in which an outcome that is strictly Pareto dominated by a 
Nash equilibrium occurs with positive probability. Finally, we prove that games that have 
a strong Nash equilibrium where at least one player puts positive probability on at least 
two pure strategies are extremely rare: they are of zero measure. 

Keywords: Non-cooperative games, strong Nash equilibrium, Nash equilibrium, 
Karusch-Kuhn-Tucker conditions, negligible set, semialgebraic map. 


1. Introduction 

It is well known that in non-cooperative game theory Q , rationality implies that the 
players can be worse off than they could be by collaborating. The most celebrated example 
is the prisoners’ dilemma, where strictly dominant strategies for the players lead to a bad 
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outcome for both. Aumann’s strong Nash equilibrium [3| gets around this paradox and 
also provides a solution concept that is robust against coalitional deviations. A strategy 
profile is a Nash equilibrium |l7) if no player has unilateral incentive to deviate, while a 
strategy profile is a strong Nash equilibrium if no coalition has incentive to deviate. It 
follows immediately that any strong Nash equilibrium outcome is weakly Pareto efficient 


for each coalition 19 


A simple refinement is super strong Nash equilibrium [21[, which requires strict Pareto 
efficiency for each coalition. There are classes of games that have a strong Nash equilib¬ 
rium, but not a super strong Nash equilibrium jl2|, so the distinction between the two 
solution concepts is meaningful. 

The strong Nash equilibrium concept is commonly criticized as too demanding because 
it allows for unlimited private communication among the players, and in many games a 
strong Nash equilibrium does not exist. For these reasons among others, relaxations have 
been proposed. A relaxation that we use in this paper is the concept of k-strong Nash 
equilibrium. It is a Nash equilibrium where no coalition of k or fewer agents has incentive 
to deviate [2j. The rationale is that in many practical situations only small coalitions can 
form. Another relaxation is coalition-proof Nash equilibrium , which is a Nash equilibrium 
that is resilient against those coalitional deviations that are self-enforcing [ 4 ]. Coalition- 
proof Nash equilibria are sometimes not Pareto efficient. 

The property of having a strong Nash equilibrium is important for a game, but not 
“usual”. In this paper we consider the class of all games with a fixed number of players, 
each of them having a fixed, finite, number of strategies, and study “how many of the 
games” have strong Nash equilibria and “what is their geometry”. In the mathematical 
literature, “how many of the games” can be given various meanings |l3}: there is the 
notion of “zero measure” set, or meager in the Baire sense, and also other, perhaps less 
known, ones: u-porosity, sparseness and so on. Here we shall use the term “negligible”, 
since, as we shall see, all these notions coincide in this setting. The reason for this is 
that the set of games that have a strong Nash equilibrium (in mixed strategies) can be 
characterized as a subset of a semialgebraic set, and for these sets all the above conditions 
to be “small” coincide. Dubey shows that strong Nash equilibria are generically in pure 
strategies in finite games [lo| . In the case of continuous convex games, existence conditions 
have been provided [l8j. In our paper, we extend the results provided by Dubey along 
several dimensions 

We take a different approach than Dubey did. Ours is based on the application of the 
indifference principle and the Karush-Kuhn-Tucker conditions [l6j that are necessary for 
weak Pareto efficiency. I11 terms of existence of strong Nash equilibrium, we provide an 
alternative proof to that of Dubey for the case with two players and we provide a stronger 
result than that provided by Dubey for the case with three or more players. Specifically, 


however, Dubey considers more general utility functions than we consider here. 
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we show that even 2-strong Nash equilibria are generically in pure strategies and therefore 
fc-strong Nash equilibria are generically pure for any k > 2. Our approach enables also 
the derivation of a number of new results. 

Our main result is the precise description of the geometry of games that admit strong 
and super strong Nash equilibria, in the following sense. When there are two players, the 
various outcomes of the games can be geometrically represented as points in the plane. We 
show that a strong Nash equilibrium in mixed strategies may exist only if all the outcomes 
of the game, restricted to the support of the equilibrium, lie on a straight line with non- 
strictly negative slope and therefore the game restricted to the support of the equilibrium 
must be either strictly competitive or have all the outcomes lying in a vertical or horizontal 
straight lineJU This also implies that in games admitting a strong Nash equilibrium all 
the outcomes of the game, restricted to the support of the equilibrium, are weakly Pareto 
efficient. Similar results hold for super strong Nash equilibrium. More precisely, a super 
strong Nash equilibrium in mixed strategies may exist only if all the outcomes of the game, 
restricted to the support of the equilibrium, lie on a straight line with strictly negative 
slope and therefore the game restricted to the support of the equilibrium must be strictly 
competitive. Furthermore, in games admitting a super strong Nash equilibrium all the 
outcomes of the game, restricted to the support of the equilibrium, are strictly Pareto 
efficient. We show instead that games with three or more players have different properties. 
Indeed, these games can have strong and super strong Nash equilibria in which the game 
restricted to the support of the equilibrium may contain outcomes that are strictly Pareto 
dominated. 

We also provide results about the computational complexity of deciding whether a 
strong Nash equilibrium exists. Our geometric characterization of two-player games that 
admit strong and super strong Nash equilibria can be exploited to design an algorithm 
whose expected compute time, once a uniform perturbation [—a, a] with a > 0 is applied 
independently to each entry of the bimatrix, is polynomial in the size of the game. Such 
an algorithm puts the problem of deciding whether a strong Nash equilibrium exists—and 
the problem of finding it—in Smoothed-P (the class of problems solvable in smoothed 
polynomial time), showing that these two problems are generically easy. A simple varia¬ 
tion, omitted in this paper, applies to super strong Nash equilibrium showing that also the 
problems of deciding whether a super strong Nash equilibrium exists and of finding it are 
in Smoothed-P. We recall that deciding whether there exists a strong Nash equilibrium 
is A/’P-complete 00 (J\fV is the class of non-deterministic polynomial time problems) 
and therefore no polynomial-time algorithm exists unless A fV = V (V is the class of poly¬ 
nomial time problems). Furthermore, finding a strong Nash equilibrium is harder than 
finding a Nash equilibrium. Indeed, finding a Nash equilibrium is WAD -complete 0 9} 


2 Games in which all the outcomes lie in a vertical or horizontal straight line are degenerate games in 
which one player is indifferent over all the actions. That is, the player can be safely removed from the 
game. 
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and WAV C HV unless A fV = co M'P jl5[ (co-A fV is the class of complementary 
non-deterministic polynomial time), but it is commonly believed that V C WAV and 
therefore that no polynomial-time algorithm exists for finding a Nash equilibrium. In¬ 
terestingly, finding a Nash equilibrium is not in Smoothed-'P unless WAV C 1ZV [f| 
(1ZV is the class of randomized polynomial time problems) and therefore it is commonly 
conjectured that finding a Nash equilibrium remains hard even as small perturbations are 
applied. Hence, although the worst case complexity of finding a strong Nash equilibrium 
is harder than that of finding a Nash equilibrium, once small perturbations are applied, 
finding a strong Nash is easier than finding a Nash equilibrium! 

2. Preliminaries 

First, we provide required notation on semialgebraic sets/functions that will be used 
in the rest of the paper. 

Definition 2.1. A subset A of an Euclidean space is called algebraic if it can be de¬ 
scribed as a finite number of polynomial equalities. It is called semialgebraic if it can be 
described as a finite number of polynomial equalities and inequalities. A multivalued map 
between Euclidean spaces is called algebraic (semialgebraic) if its graph is an algebraic 
(semialgebraic) set. 

For example, a circle in M 2 is an algebraic set, an interval in K. is a semialgebraic set. 
We shall use the idea of dimension of a set, and this should be defined in general, but 
since here it is used for simplexes and/or affine spaces, it is enough to keep in mind that 
this coincides with the usual idea of dimension in linear analysis. 

Here we need only two facts about semialgebraic maps: 

• Given an algebraic set A on X x Y, its projection on each space X, Y is semialgebraic 
(see j8|, Section 1.3.1, the Tarski Seidenbreg theorem). 

• For any semialgebraic set-valued mapping <f> between two Euclidean spaces $ : E =1 
Y, if dim <I> (x) < k for every x £ E, then dim <I> (E) < dim(P) + k, where dim A 
denotes the dimension of a given set A (see Q, Theorem 3.18). 

We now introduce additional notation and definitions that we will use. For vectors 
x. y in some Euclidean space, we use the notations x > y, x > y and x » y to say that 
Xi > yt for all i, Xi > y l for all i and x j- y, and Xi > y t for all i, respectively. We will use 
Pareto domination in the following setting. We consider a function F : WL k —* M n , and a 
set U C R k . 

Definition 2.2. A vector x = (xi,... ,Xk) £ U is weakly Pareto dominated for the 
problem (F. U ) if there exists a vector x £ U such that 


F(x) > F(x) 


5 


while x is said to be strictly Pareto dominated for the problem ( F, U ) if there exists x G U 
such that 


F(x) » F(x). 


On the basis of the concept of Pareto dominance, Pareto efficiency can be defined. 

Definition 2.3. A vector x is strictly Pareto efficient for the problem (F, U ) if there is 
no x that weakly Pareto dominates x, while it is weakly Pareto efficient for the problem 
(F, U ) if there is no x that strictly Pareto dominates x. 

We will be interested in the case where U can be described in terms of affine inequal¬ 
ities. Thus, let us consider G : R fc —» R l , Ft : M fc —> W, G, H linear, b,c vectors of the 
right dimensions, and define U to be 

U = {xeR k : G{x) > b, H(x) = c}. 


In such a case, if x G U is weakly Pareto efficient, then the Karush-Kuhn-Tucker (KKT) 


conditions 16] state that there are vectors A, p, u that satisfy the following system: 


A t WF(x) +n t WG(x) + u t WH(x) = 0 n , (la) 

p)G(x) = 0, (lb) 

H > 0;, (lc) 

A > 0 j. (Id) 


Now we introduce the standard concepts from non-cooperative game theory that we 
will use in the paper. 

Definition 2.4. (Strategic-form game) A finite strategic-form game fl^i l is a tuple (N, A , U) 
where: 

• N — {1,..., n} is the set of players, 

• A — Ai x A 2 x ... x A n is the (finite) set of aggregate agents’ actions: Ai is the set 
of actions available to agent i, 

• U = {Ui ,..., U n } is the set of agents’ utility tensors, where Ui : A —> M is the utility 
function of agent i. 

We shall denote by rri t > 1 the number of actions in Ai, and by a t j , j e {1, a 

generic action; U is a n x m\ x m 2 x ... x m n tensor. A generic element of U t will be 

denoted by Ui(ii,, i n ). 

We denote by A* the simplex of the mixed strategies over Ai, and by ay a generic 

mixed strategy of agent i: Xi = (xn, ...,Xi m f). Given Xi G A ? ; we denote by Si{xi) its 
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support, that is the set of actions played with strictly positive probability, and, given a 
strategy profile x, by S(x) the support profile (Si(xi),..., S n (x n )). 

Given a strategy profile x, the utility of agent i is 

Vi(x) = ^ U i (i 1 ,...,i n )-x il . x in := x^UiYlxj. 

Given a strategy prohle x, we shall use x_* to denote the vector, with n —1 components, 
X-i = (x \,..., Xi- 1 , Xi + 1 ,..., x n ) and we shall also write x — (x*, X-i). 

Definition 2.5. A strategy profile x = (xi,..., x n ) is a Nash equilibrium if, for each 
i 6 N, Vi (x) > ly (xj, x^) for every x { gA*. 

More explicitly, x is a Nash equilibrium if x\U l Xj > xffJ % % for every z G iV, 
for every x* G A*. 

Given a mixed strategy prohle x, and denoting by Uf\s i the matrix containing only 
the rows in Si, and by Ui\s? its complement, the problem of finding a Nash equilibrium 
can be expressed as the problem of finding a prohle strategy x and, for all i G N, a real 
number v* such that: 


i*n*i = 

v * • 1 

u i J -m i 

Vi eN 

(2a) 

j¥=i 

SfH X j < 

V* ■ 1 m , 

Vi eN 

(2b) 


Xij > 

0 

Vi G N, Vj G {1, ..,rrii} 

(2c) 

X i ‘ 1 mi = 

1 

Vi e N 

(2d) 


where l mi is a column vector of m; positions with value 1 in every position. As is 
customary, we shall refer to the conditions in d2al) as the indifference principle. 

Finally, we are ready to dehne the key objects of study in this paper: Nash equilibria 
that are efficient for each coalition of players. 

Definition 2.6. A strategy profile x = (xi,... ,x n ) is a super strong Nash equilibrium if 
it is a Nash equilibrium and it is strictly Pareto efficient for every coalition of players. 

Definition 2.7. A strategy profile x = (xi,... ,x n ) is a strong Nash equilibrium if it is 
a Nash equilibrium and it is weakly Pareto efficient for every coalition of players. 

We consider also relaxations of strong and super strong Nash equilibria in which we 
require the resilience against coalitions of size k or less only, see [2]. 

Definition 2.8. A strategy profile x = (xi,..., x n ) is a k-super strong Nash equilibrium 
if it is a Nash equilibrium and it is strictly Pareto efficient for every coalition of k or 
fewer players, and it is a k-strong Nash equilibrium if it is a Nash equilibrium and it is 
weakly Pareto efficient for every coalition of k or fewer players. 
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3. Mixed strong Nash equilibria in two-player games 

In this section we consider the two-player setting. Later in the multi-player setting we 
will leverage some of these results. This is quite natural: since strong Nash equilibrium 
requires efficiency for all coalitions, we will use the results obtained in this section to the 
coalitions made by two players within the multi-player games. 

We start the analysis focusing on a fully mixed strong Nash equilibrium. The game 
can be described by a bimatrix (Ui, U 2 ) where U\ = (u\ r ) and U 2 = (u 2 ). 

3.1. Mixed strong Nash equilibria with full support 

Obviously, adding a constant to the payoffs of all players, and/or multiplying them 
by a positive constant, does not change the set of the strong Nash equilibria of the game. 
Thus, we shall assume without loss of generality that at a given equilibrium x = (xi,x 2 ) 
both players get zero: x\UiX 2 = 0 and x\U 2 X\ = 0. In other words, we are assuming that 
v* = 0 in (l2al) and (l2bl) for i — 1,2. 

Proposition 3.1. Let x be a fully mixed strong Nash equilibrium. Then it must fulfill the 
following system of linear equalities/inequalities, for some A = (Ai, A 2 ) and v = (zy, u 2 ): 


\ 2 x 2 U 2 + zql mi 
\\x\U\ + z/ 2 lm 2 


(3a) 

(3b) 

(3c) 


A > 0 


Proof The proof follows from the application of the KKT conditions and the indifference 
principle. The elements used in the KKT conditions are 


F{x) = ( fi(x) f 2 (x ) ) = ( x\Uix 2 x f 2 U 2 x 1 j 




Vfr(x) Im\-hm,2 

VH(x) 



and therefore 
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where I mi+m2 is the identity matrix with m,\ + m 2 rows and columns. 

From (flaj) and from the fact that x is fully mixed, we have p = 0 mi _|_ m2 . From the fact 
that x is a Nash equilibrium and that, by assumption, v\ — v 2 — 0, we have U\X 2 = O mi 
and U 2 X 1 = 0 m2 . The claim follows straightforwardly. ■ 

Lemma 3.1. Let T := (£4, U 2 ) be a bimatrix game with > 2. 

Let x be a fully mixed super strong Nash equilibrium of V satisfying the system Hfc\) . 
UfOi). T3d) . Then it satisfies the further conditions 

U\X\ 0 m2 , U 2 X 2 0 mi 


also with strictly positive Ai, A 2 . 

Let x be a fully mixed strong Nash equilibrium of T satisfying the system [Safi . f3U) . 
fM) - Then either it satisfies the further conditions 

U\X\ 0 m , 2 , U'2^2 Omi 

or all entries of the bimatrix (U\,U%) lie either on a vertical or on a horizontal line 
through the origin. So, other than in the case where the entries of the bimatrix lie on a 
horizontal or vertical line, a fully mixed strong Nash equilibrium satisfies the equations 
nfc\) . Wdil.TSd) also with strictly positive Ai, A 2 . 

Proof We first prove the claim about super strong Nash equilibrium and then the claim 
about strong Nash equilibrium. 

Super strong Nash equilibrium. Suppose, without loss of generality, Ai > 0. We have 
the following steps. 

Step 1. We show x\U\ — 0^ 2 . From (j3b|) we know that x\Ui = —1^. By assumption, 
we have x\UiX 2 = 0 and therefore ^ 1 ^X 2 = 0. Given that 1^ 2 J2 = 1, it follows that 
v 2 = 0 and thus x\U\ — 0*„ 2 . 

Step 2. We show x\U 2 = 0^ . Initially, we show x t 2 U 2 < 0^ . Suppose for contradic¬ 
tion that there is a column j such that x\Ul > 0. Then, the strategy profile y = (x\,x 2 ), 
where x\ is the pure j'-th strategy of player 1, weakly Pareto dominates x. Indeed, 
x:\U 1 X 2 = X 2 U 2 X 1 = 0 by assumption, whereas x\U 1 x 2 = 0 and x t 2 U 2 x 1 >0. As a result, 
we have a contradiction, x being a super strong Nash equilibrium and therefore it cannot 
be weakly Pareto dominated. Thus, xt 2 U 2 < 0* n] . Finally, given that x\U 2 X 1 = 0 and 
X\ > 0 mi , we have that x|[/ 2 < 0 1 implies x t 2 U 2 = 0^ . 

Step 3. Given that x 2 U 2 = 0* ni , (j5a|) is satished for — 0 and any A 2 , strictly positive 
values included. In other words, if x a super strong Nash equilibrium, the system fjSajl . 
fj3b|l . (j3cT) admits a solution with strictly positive Ai, A 2 . 

Strong Nash equilibrium. The above proof does not apply here. This is due to Step 2. 
It requires x not to be weakly Pareto dominated, but a strong Nash equilibrium may be 
weakly Pareto dominated. We observe in addition that, if the system (j3aj) , f[3b]) . (I5cl) is 
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satisfied at x when Ai and A 2 are strictly positive, the proof easily follows from Steps 1-3. 
Indeed, Step 1 directly applies and we have x\Ui = 0 f m2 . In addition, by a simple variation 
of Step 1 when A 2 > 0 (instead of Ai >0), we have x t 2 U 2 = 0^, • Therefore, we need to 
complete the proof for the case in which the system (|3ajh (j3b|) . (j3c|) is satished at x only 
when one of the two components of A, say A 2 , is vanishing, given that KKT conditions 
exclude the case in which both Ai and A 2 are equal to zero. By applying Step 1, we already 
know that x\U\ — 0( n2 , but, since A 2 must be 0, there must be j such that x\Ul >0. We 
have the following steps. 

Step 4. We show iff = 0 for all %. Suppose for contradiction that there is i such 

that u{ 1 7 ^ 0. Then, since x\ U 1 = 0 ( n2 and X\ > 0, there are k, l such that u{ k > 0 

and u{ 1 < 0. Since x 2 U% > 0, there is a neighborhood B of x 2 (in the simplex) such 

that for all y e B it is y t U 2 > 0. Then it is possible to choose e > 0 so small that 

X 2 = (X 21 , • • •, X 2 k + €,... ,X 2 / — e,...) is in B, but this is a contradiction, since x is 
strictly Pareto dominated by y — (ah, £ 2 ), where ay is the pure j th strategy of player 1. 
Indeed, x:\U 2 X 1 > 0 = x 2 U 2 Xi and x:\U 1 X 2 > 0 = x\U\X 2 ■ Therefore, it must be that 
u\ l = 0 for all i, and this means that all entries of row j of the bimatrix (U l} U 2 ) lie on a 
vertical line through the origin. 

Step 5. We show uf = 0 for all i and l. Suppose for contradiction that id/ > 0 
(observe, i ^ j). Then consider the following strategy ah for player 1: 


{ x lk =0 if k^i,j 

x u = a > 0 

xij = 1 — a 


with a so small that (1 — a) '^2, k X2k'u% + 2 ku\ l > 0. Consider also the strategy X 2 

for player 2: 

x 2k = x 2k if k^l,m 

X21 = x 2 i + e 

k ^2m ^2m £ 

for m such that u l ™ < o[f|and e so small that ah G B and (1— a) X 2 kU% +cr % 2 kU 2 l > 
0. By construction, we have x:\U 2 X 1 > 0. In addition, we have x\U\x 2 = x:\U 1 X 2 + 


(1 — cr)(eu{ 1 — eu{ m ) + a(euf 


eu\ 


) = (1 — a)(eu{ 1 — eu{ m ) + <j(eu*/ — en^” 1 ), but, since 


u i = u \ m — 0 as showed in Step 4 and u l { > 0 and u\ m < 0 by assumption, x\UiX 2 > 0 and 
therefore we have a contradiction, given that strategy profile x strictly Pareto dominates x. 
Thus player one gets zero at every outcome. This means that all the outcomes of the 
bimatrix he on the vertical axis. ■ 

We can now prove the main theorem of this section. 


3 Remember: x 2 U[ = 0 and thus, since uf > 0 there must be also a negative entry in the row i. 
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Theorem 3.1. Let T := {U\, U 2 ) be a bimatrix game with max{mi,m 2 } > 2. 

Let x be a fully mixed super strong Nash equilibrium ofT, providing zero utility to both 
players. Then all the entries u := (uf, u 2 ) of the bimatrix lie on the same straight line 
with strictly negative slope, passing through the origin. 

Let x be a fully mixed strong Nash equilibrium of T, providing zero utility to both 
players. Then all the entries vN := (uf, u 2 ) of the bimatrix lie on the same straight line 
with non-strictly positive slope, passing through the origin. 

Proof We first prove the claim about super strong Nash equilibrium and then the claim 
about strong Nash equilibrium. 

Super strong Nash equilibrium. We have the following steps. 

Step 1. We show that all the entries u on a fixed row i lie on the same straight 
line through the origin and the same holds for a fixed column j and these straight lines 
cannot be vertical or horizontal. Let us focus on the rows, the same reasoning can be 
applied to the columns. Suppose for contradiction that for a given row i the entries u y ' 
do not lie on the same straight line. Consider the convex hull of the entries u in the 
space of the players’ expected utilities. This is a polygon whose vertices are a subset of 
the entries vN. For each point of the polygon, there is a strategy £ 2 such that 

x\UiX 2 = v\ and d:\U 2 X 1 = V 2 , where x\ is the i-th pure strategy of player 1. In addition, 
by Lemma [3711 we know Upx 2 = U 2 x 2 = 0 mi and therefore the point (0,0), corresponding 
to the players’ expected utilities given by strategy profile x = (xi,x 2 ), is in the interior 
of the polygon given that x 2 is fully mixed. Thus, we have a contradiction since there 
must be a strategy profile x = (ah,x 2 ) such that x:\U 1 X 2 = e\ > 0 and x 2 U 2 Xi = e 2 > 0 
for some small e\, e 2 , where (ei, e 2 ) is on the boundary of the polygon, and therefore x is 
strictly Pareto dominated by x. This shows that all the entries w*- 7 for a given row i lie on 
the same straight line passing through the origin. In a similar way, we obtain that all the 
entries w*- 7 for a given column j lie on the same straight line passing through the origin 

Finally, each straight line has strictly negative slopes or collapses to a single point. 
Otherwise, if there is at least a straight line with strictly positive slope, there must be a 
strategy profile x = (xi,x 2 ), as defined above, that weakly Pareto dominates x. 

Step 2. We show that all the entries w*- 7 lie on the same straight line. Suppose for 
contradiction, without loss of generality, that the entries of two rows i, j belong to different 
lines passing through the origin. Then, there must be two columns h, k with h ^ k such 
that the points u lh and u^ k do not belong to the same straight line passing trough the 
origin. Note that h must be different than k due to Step 1 that forces all the entries of 
the same column to be on the same straight line passing through the origin. Let us now 
consider the sub-bimatrix 

fu ih u ik \ 

\u jh u jk ) ' 

We assume that the segment joining u lh and u^ k intersects the first orthant. This as¬ 
sumption is without loss of generality, because, for each pair of u lh and u^ k such that the 
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segment joining them does intersect the third orthant there is a pair u lh ' and v? k ' such 
that the segment joining them does intersect the first orthant. 

We must have u lk = (0,0). If u lk (0,0), then u lh and u jk would be on the same 
straight line passing trough u lh and (0,0); this contradicts the assumption that u lh and v? k 
do not belong to the same straight line passing through the origin. The same reasoning 
applies to n ]h , and therefore v? h = (0,0). Thus, what remains to be done is to consider 
the case 

/ u ih (0,0)\ 

V(0,0) u jk J • 

What we need to prove is that this configuration leads to a contradiction. Since we 
assumed that the segment joining u lh and vJ k intersects the first orthant, there is t > 0 
such that 

tu ih + (1 - t)u jk = (2e, 2e) 

for some e > 0. Consider the strategy prohle x = (ah, £ 2 ) = [(£, 1 — t),(|, ■)■)]. Then 
x\UiX 1 = e > 0 for i = 1, 2, contradicting the fact that a; is a super strong Nash equilib¬ 
rium. 

Strong Nash equilibrium. In this case, the above Step 1 applies with the exception 
that the straight lines can be vertical or horizontal as stated by Lemma 13.11 while Step 2 
applies here without exception. This concludes the proof. ■ 

Corollary 3.1. Let T := (Ui,Utf) be a bimatrix game with max{mi,m 2 } > 2. 

Suppose T has a super strong Nash equilibrium with fully mixed strategies, then it is a 
strictly competitive game. 

Suppose T has a strong Nash equilibrium with fully mixed strategies, then either it is 
a strictly competitive game or all entries of the bimatrix (U\,Uf) lie either on a vertical 
or on a horizontal line through the origin. 

A strictly competitive game is a game such that, up to a suitable rescaling of the 
utility of one player, the game is zero sum [l 1 ]. An example of strictly competitive game 
is depicted in Fig. [0 Corollary 13.11 implies that a necessary condition for the existence 
of a super strong Nash equilibrium in fully mixed strategies is that all the outcomes are 
strictly Pareto efficient and that a necessary condition for the existence of a strong Nash 
equilibrium in fully mixed strategies is that all the outcomes are weakly Pareto efficient. 
Furthermore, Corollary 13.11 requires also that all the outcomes lie on the same straight 
line. This is the simplest case in which all the outcomes are Pareto efficient and, in this 
case, any Nash equilibrium is also strong. 

3.2. Mixed strong Nash equilibria without full support 

The results obtained above can be rephrased also in the case of Nash equilibria with 
no full support. This is quite simple to do, for the following reason. Given the game 
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Figure 1: Example of a 2-player strictly competitive game (left) and its Pareto curve (right) in which 
the expected utilities of the players at the SNE are (0,0). 

T := {U\, Uf), if we consider a mixed strategy (super) strong Nash equilibrium profile 
x, then it is clear that its restriction on the support S(x ) must necessarily be a (super) 
strong Nash equilibrium for the game T r whose bimatrix is the restriction of {U \, Uf) to 
S(x). Thus the above result applies, and all the outcomes of the restricted game must 
lie on straight line with strictly negative slope, in the case of super strong Nash, or on 
a straight line with non-strictly positive slope, in the case of strong Nash. Observe also 
that the games having a Nash equilibrium with one player using a pure strategy and 
the other one a mixed, non pure, strategy, is itself zero measure, without requiring any 
form of efficiency of the Nash equilibrium. I 11 particular, this easily implies the following 
existence result. 

Theorem 3.2. In the space of all the bimatrix games of fixed dimension, the set of games 
having a strong Nash equilibrium in which at least one player plays a mixed strategy has 
zero measure. 

More precisely, we have shown that this set of games with strong Nash equilibria where 
at least one player uses a mixed strategy is contained in a subspace of dimension strictly 
less than the whole space. The above theorem obviously implies the same result also for 
super strong Nash equilibrium, given that super strong Nash equilibrium is a refinement 
of strong Nash equilibrium. We recall that the set of games with at least one strong Nash 
equilibrium contains an open set and therefore games lying in the interior of such set do 
necessarily possess a strong Nash equilibrium in pure strategies. 

3.3. Smoothed-V complexity and strong Nash equilibrium 

The characterization provided by Theorem 13.11 suggests a simple algorithm to find an 
SNE in bimatrix games. Initially, we introduce two conditions the algorithm exploits: 
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Condition 1 := “there is 2x2 sub bimatrix of (U\. Uf) in which all the entries lie on a 
line”; 

Condition 2 := “there is 2x1 sub bimatrix of (U\. Uf) in which all the entries lie on a 
vertical line or there is 1x2 sub bimatrix of (U\, Uf) in which all the entries lie on a 
horizontal line”. 


Algorithm 1 SNE-hnding([/i, Uf) 

1: for all pure-strategy prohles x do 
2: if a; is a Nash equilibrium then 

3: if x is Pareto efficient then 

4: return x 

5: end if 

6: end if 

7: end for 

8: if Condition 1 holds or Condition 2 holds then 
9: for all support prohles S do 

10: if there is a Nash equilibrium x* with S(x) = S (in case of multiple equilibria 

take x* as the equilibrium maximizing the social welfare) then 
11: if x* is Pareto efficient then 

12: return x* 

13: end if 

14: end if 

15: end for 

16: end if 

17: return NonExistence 


We recall that, given a strategy profile x, it can be verified whether x is weak Pareto 
efficient (Steps 3 and 11) by means of the algorithm described in 0, while, given a 
support profile S, it can be verified whether there is a Nash equilibrium x* with S(x) = S 
(Step 10) by means of linear programming as shown in (ioj ]. 

Theorem 3.3. Let T := (U\,Uf) be a bimatrix game. The problem of finding a strong 
Nash equilibrium ofT is in Smoothed-V. 

Proof In order to show that the problem of Ending a strong Nash equilibrium of T is in 
Smoothed-P, we need to show that the expected time of Algorithm |Tj once a perturbation 
[—cr, -|-cr], where a > 0, with uniform probability is applied to each entry of the bimatrix 
independently is polynomial in the size of the game (i.e., m\ and mf) [5j. 

We initially observe that Steps 1-7 of Algorithm Q] have complexity polynomial in 
the size of the game, the number of pure-strategy prohles being m\ ■ m 2 and Steps 2-3 
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requiring polynomial time in m i and m 2 . Then, we observe that, once a perturbation 
[—<7, +cr] with uniform probability is applied to each entry of the bimatrix independently, 
Condition 1 and Condition 2 are verified with zero probability. Then, Steps 9-15, that 
require exponential time in mi and m 2 in the worst case, are executed with zero proba¬ 
bility. This proves that the expected time of Algorithm [Tj is polynomial in mi and m 2 . 
■ 

This shows that the problems of deciding whether a strong Nash equilibrium exists 
and of finding it are generically easy. A simple variation of Algorithm [1] can be designed 
to show that also the problems of deciding whether a super strong Nash equilibrium exists 
and of finding it are generically easy. 


4. Setting with more than two players 

I 11 this section, we extend our analysis to a generic n-player game, in order to see what 
conditions concerning the existence of a mixed-strategy strong Nash we can obtain. The 
application of the indifference principle and of the KKT conditions leads to an equation 
system that, differently from the two-player case, is not linear. For this reason, we resort 
to semi-algebraic set-valued mappings. Here the result. 

Theorem 4.1. In the space of all n-player games of fixed dimension, the set of games 
having a 2-strong Nash equilibrium in which at least one player plays a mixed strategy 
has zero measure. 

Proof We initially prove the theorem for super strong Nash equilibrium and subsequently 
for strong Nash equilibrium. 

Super strong Nash equilibrium. Consider a generic support profile in which at least one 
player randomizes over at least two actions. Let s* the number of actions in the support 
of player i and, without loss of generality, let s n = max{sj} > 2. 

i£N 


By applying the IP, we derive the following equations: 

Ui xj = v*l Si Vi e N 

iVi 


(4) 


By applying the KKT conditions to all the coalitions of two players of the form {i, n) 
for all i < n — 1, we derive the following equations: 


T A n,(i,n)U n Xj lsj £ -A" \ {A} 

i¥=i 


(5) 


Xj T ^n,(i,n)'^ n ^~Sn ^n,(*,n)ls n ^ AT \ {A} 

From equations (j6]), we derive the following equations, for some v*: 

Ui n Xj = v*l Sn Vie N\ {n} 
i+n 


( 6 ) 


( 7 ) 


15 


From the sets of Equations (j4j) (used for i = n) and (JTJ) (used for all i ^ n), we extract 
the following subset of equations: 



= vll 

d+n 


u 2 n x j 

= v* 2 l 



Un n X 3 

= v*l 




( 8 ) 


The above set is composed of ns n equations. Call k the row describing the k -th linear 
equation (k — 1,..., ns n ), where Ui, U 2 ,... ,U n are unknown, while aq and v* are fixed 
for every i e TV. 

We denote the space of the si % s 2 X ... s n _i tensors by M slXS2X "' XSn_1 . Consider the 
algebraic set-valued mapping 


$ : A S1 x A S2 x ... x A 5 "" 1 x M" =1 (M slXS2X "' XSn_1 ) nSn 


defined as 


$(xi,x 2 ,.. .,x n ,v\,vl, ...,<) = 


< (Bi, B 2 ,..., B 

ns n ) X\ x,-v 

v 


r^i 


= 0, Wk < ns r 


We want to show that <h(A Sl x A S2 x ... x A s 1 x M n ) is negligible. 
Observe that, for non null (aq, x 2 ,..., x n -\) to ensure 

(Bx, B 2 ,..., B nSn ) e $(x 1 ,x 2 ,...,x n ,vl,v%,...,v*) 


simply requires each tensor B{, independently, to lie in some hyperplane in a space of 
ns\s 2 ... s n dimensions, and hence 


dim <f>(xi, x 2 ,.. .,x n ,vl,V 2 , ...,<) = ns x s 2 ...s n - ns n . 


From this we get that 

dim <I>(A' S1 x ... x A Sn_1 x M n ) = 

= ns 1 ...s n -ns n + (s 1 -l) + ... + (s n _i - 1 ) + n 

< nsx... s n - ns n + (si + ... s n _ i) + 1 

< ns\... s n - ns n + (n - l)s„ + 1 

< nsi... s n 

since s n > 2. Therefore the set of tensors satisfying the conditions is negligible with 
respect to the space of all the utility tensors. Given that the above property holds for 
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every (non-pure) support profile and given that the support profiles are finite, the thesis 
of the theorem follows straightforwardly. 

Strong Nash equilibrium. The above proof for super strong Nash equilibrium applies 
directly also for strong Nash equilibrium whenever multipliers f° r every i are strictly 

positive. Indeed, in this case, for each coalition (i , n) we have Ui n Xj = v*l Sn and 

j¥=n 

therefore we can derive entirely the equation system (JSJ) . However, we know that a strong 
Nash equilibrium may satisfy KKT conditions even when some multiplier is zero and such 
a null multiplier may be, in principle, A i,(i,n) for some coalition ( i,n ). In this case, the 
above proof for super strong Nash equilibrium does not apply directly for strong Nash 
equilibrium. We show below how the proof can be modified to capture this case. 

Initially, consider a generic support profile in which all the players randomize over at 
least two actions. Let s* the number of actions in the support of player i and, without loss 
of generality, let s n = max{sj} > 2. We consider all the coalitions of two players in which 

i£N 

one player is n. Suppose that, for at least one coalition (f, n), KKT conditions are satisfied 
only for — 0. The proof of Lemma 13. II shows that in this case U n Xj = u*M^ XSn 

where is a Si x s n matrix of ones. Indeed, fixed Xj for every j ^ i,n, the game 

reduces to a bimatrix game (U-. U1) between players i and n where U[ = U t Xj and 

j¥=i,n 

k = n Xj and Lemma 13.11 shows that all the entries of U' n are equal to v* when 

Xi — 0. We use these conditions together with the equations due to the indifference 
principle for all the players j ^ n, obtaining: 


Uj n Xk — 

k ¥=j 

* -i 

VjeN\{n} 

(9) 

Un 11 %k 
k^i,n 



(10) 


As in the proof for the super strong Nash equilibrium, call <3> the algebraic set-valued 
mapping that, given (aq, x 2 , ■ ■ ■ , x n , v^, ■ ■ ■ , v*) returns the set of tensors U \,..., U n 

(each of size K[j s j) satisfying the above set of equations (IfJll- dlU . It can be seen that 
dim <h(A Sl x A 52 x ... x A Sn x M n ) = n Sj + s n ( 1 — s*) < n Sj and therefore is 
negligible. 

Finally, consider a generic support profile in which at least one player randomizes over 
at least two actions. Extract the reduced game containing only the actions belonging 
to the supports of the players and in which all the non-randomizing players have been 
discarded. Then, apply the above arguments to the reduced game in which all the players 
randomize. We obtain that the reduced game cannot be generic and therefore the original 
game cannot be generic. 

Given that the above property holds for every (non-pure) support profile and given 
that the support profiles are Enite, the thesis of the theorem follows straightforwardly. 
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Let us note that Dubey shows in Tc| that, generically, in a Pareto efficient Nash 
equilibrium at least one player plays a pure strategy and that in a strong Nash equilibrium 
all the players play pure strategies. The above result shows that generically pure-strategy 
equilibria are the only possible ones even when the resilience to multilateral deviations is 
required only for coalitions of two or less players. 

To conclude, let us make the following observation. In the two-player case, our result 
shows that existence of a mixed strong Nash equilibrium requires that all the outcomes 
restricted to the support of the equilibrium are weakly Pareto efficient. Interestingly, this 
is no longer true with three players. 


Proposition 4.1. Mixed strong Nash equilibria of three-player games may have outcomes 
that are strictly Pareto dominated. The same holds for super strong Nash equilibrium. 


Proof sketch We consider the following game with three players, in which every player 
has two available actions: 


M 1 = 


( ( 2 , 0 , 0 ) 
\( 0 , 0 , 2 ) 


( 0 , 2 , 0 )\ 

(0,0,0V 


,M 2 


f (0,0,0) (0,0, 2)\ 

\(0, 2, 0) (2,0,0V ■ 


The profile strategy ((2, |) , (2, |) , (|, |)) is a super strong Nash equilibrium. For, 
it is easy to see that ((|, , (§, , (|, |)) is a Nash equilibrium, with value v* = 
(|, ~, -(). Then, it is possible to prove that neither the coalitions made by two players 
nor the grand coalition have incentive to deviate from the Nash equilibrium. Calcula¬ 
tions are straightforward, but long, and thus we report them in Appendix A Therefore, 
((|, 2 ) ’ (!> §) > (§, I)) is a super strong Nash equilibrium. 

Finally, it is easy to see that the strong Nash equilibrium strictly Pareto dominates 
outcome (0,0,0). This concludes the proof. ■ 


Observe that in the example above there are repeated entries in the matrices, but 
small perturbations of the two matrices provide the same results, having all triples of the 
two matrices different each other. Thus the above example is generic. Proposition 14.11 
shows that the geometric characterization in terms of alignment of the bimatrix entries 
of two-player games admitting (super) strong Nash equilibria cannot be extended to the 
case of three or more players. Furthermore, it is not clear whether there is a simple 
geometric characterization in the case of three or more players. This leaves the question 
of setting the problem of deciding whether there is a (super) strong Nash equilibrium in 
Smoot hed V open. 


5. Concluding remarks 


In this paper we analyzed the problem of characterizing the set of finite games having 


strong Nash equilibria, extending the results provided by Dubey in 10]. Our main result 
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concerns the characterization of two-player games admitting strong and super strong 
Nash equilibria. We showed that the game restricted to the support of the equilibrium 
must be strictly competitive in the case of super strong Nash equilibrium and must be 
either strictly competitive or with all the outcomes that lie on a horizontal or vertical 
line in the case of strong Nash equilibria. This implies that all the outcomes of the game 
restricted to the support of the equilibrium must be Pareto efficient. This is no longer 
true in the case of three or more players, where instead the support of even super strong 
Nash equilibria may contain strictly Pareto dominated outcomes. For these games, we 
show that even 2-strong Nash equilibria are generically in pure strategies. Our geometric 
characterization of two-player games admitting a strong Nash equilibrium leads to the 
design of a simple algorithm that puts the problems of deciding whether there is a strong 
Nash equilibrium and of finding it in Smoothed-P. This shows that such problems are 
generically easy. 

The main question we leave open concerns the characterization of the geometry of 
games with three or more players admitting strong Nash equilibrium. It is not clear 
whether or not their geometry can lead to the design of a Smoothed-P algorithm. 


Acknowledgements. The authors gratefully acknowledge Prof. A. Lewis for bring¬ 
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Theorem 14.11 and Prof. S. Sorin for bringing our attention to the paper lol . 
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Appendix A. Proof of Proposition [47X1 

We need to prove that neither the coalitions made by two players nor the grand 
coalition have incentive to deviate from the Nash equilibrium. First of, the coalitions 
made by two players. We fix the strategy of player 3, but since the game is completely 
symmetric, the same argument holds for every player. We calculate the expected utility 
of player 1 and player 2 and we force them to be strictly greater than 1. 


2 • -£iix 2 i + 2 • -£ 12 X 22 > 2 

1 1 1 
2 • -£11X22 + 2 • -£12X21 > 2 

Since x*i + £*2 = 1 we can write: 

£11X21 + (1 - £11) (1 - £21) > ^ 

£11 (1 -£21) + (1 -£ii)x 2 i > ^ 

and we obtain: 

2xii£2i - £n - £21 + 1 > ^ 

1 

£11 + £21 - 2 xii£ 2 i > - 


By summing the two constraints we obtain 1 > 1 and therefore the system is unfeasible. 
We do now the calculations for the grand coalition. 


2xn£2l£31 + 2 x 12 X 22 X 32 > - 

1 

2 xii£ 2 2 £ 3 i + 2x12X21X32 > 2 

1 

2x11X22X32 + 2x12X21X31 > 2 
By replacing x *2 by 1 — x*i we can write: 


2x11X21X31 + 2 (1 - Xu) (1 - x 2 i) (1 - £31) 
2 xn (1 - x 2 i) £31 + 2 (1 - x n ) x 2 i (1 - £31) 
2 xn (1 - £21) (1 - £31) + 2 (1 - xn) £21X31 


> 

> 

> 


1 

2 

1 

2 

1 


2 
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and we obtain: 

2 — 2x21 ~ 2^31 + 2x21X31 — 2xn + 2xnX2i + 2x11X31 > — 

2x11X31 + 2 x 2 i - 2x11X21 - 2x21X31 > i 

2xn - 2xnX2i - 2x11X31 + 2x21X31 > i 

By isolating Xu, we can write the following system of inequalities: 


Xn(x 31 + X21 - 1 ) > i - (1 - X 2 l)(l - X31) 

(A.l) 

Xii(x 3 i - X21) > ^ - 3:21(1 - X 3 i) 

(A.2) 

. . 1 

Xn(l - X31 - X21) > - - 3:21X31 

(A.3) 

Xn,x 2 i,x 3 i > 0 


341, X21, X 3 1 < 1 



We show that this inequality system is never satisfied. To do this, we consider all the 
possible cases characterized by the sign (=,<,> 0) of x 3 i + x 2 i — 1 and x 3i — x 2 i- 

The case in which x 3i + x 2 i — 1=0, independently of the value of x 3i — x 2 i, inequal¬ 
ity (1A.3|1 can be written as 2 — X2i(l — X21) > 0 that is never satisfied given that the 
maximum of \ — X2i(l — X21) is 0 for x 2 i = The case in which X31 — X21 = 0, indepen¬ 
dently of the value of 1 — X31 — X21, inequality (IA.2|) can be written as ^ — x 2 i (1 — x 2 i) > 0 
that, as proved before, is never satisfied. 

The case in which (x 3 i + x 2 i — 1 > 0 A x 3 i — x 2 i > 0) we can write inequalities (lA.ip . 
(ICTh (GOD as 


7 - (1 - ®2l)(l - ®3l) 

xu >-;-i- 

X 31 + X 2 l ~ 1 

7 - ^2l(l - 3:31) 

Xu > - 

X 31 - X 2 1 

X2,lX 31 ~ \ 

Xu < -— 

X 3 1 + X 2 1 - 1 


(A.4) 

(A.5) 

(A.6) 


By combining inequalities (1A.4I) and (1A.6I) we obtain: 

\ - (1 ~ S2l)(l ~ 3:3l) _ X 2 lX 31 ~ \ 

X31 + X 2 l - 1 X31 + X 2 1 - 1 

1 


X 2 1 + x 31 ~ 2X21X31 ~ ~ < 


0 

0 


(A.7) 
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By combining inequalities (1A.5|) and (1A.6|) we obtain: 

\-X 2 l(l-Xz l ) X 2 iX 3 i-\ 


x 3 i ~ X21 


X31 + X21-I 


< 0 


1 

X 31 < o 


(A.8) 


From X 31 — X 21 > 0 and inequality (1A.8I) . it follows that X 21 X 31 < From this last 
inequality and inequality flA.7j) . it follows that X 21 + X '31 — 1 < 0. Given that we are 
assuming x 3i + x 2 i — 1 > 0 , the inequality system cannot be satisfied. 

The cases in which (x 3 i+x 2 i —1 > 0 A x 31 —x 2 i < 0), (x 3 i+x 2 i — 1 < 0 A x 31 —x 2 i > 0), 
and (x 3 i + x 2 i — 1 > 0 A x 31 — x 2 \ < 0) lead to calculations similar to the case in which 
(£31 + x 2 i — 1 > 0 A £31 — x 2 i > 0). This completes the proof. ■ 















